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Abstract 

o : 

»vj , The value of plant model information available in the control design process is discussed. We 

design optimal state-feedback controllers for interconnected discrete-time linear systems with 
stochastically-varying parameters. The design of each controller relies only on (i) exact local 
plant model information and (ii) statistical beliefs about the model of the rest of the system. 
We consider both finite-horizon and infinite-horizon quadratic cost functions. The optimal state- 
feedback controller is derived in both cases. The optimal controller is shown to be linear and 
to depend on the model parameters and statistics in a particular way. Furthermore, we study 
the value of model information in optimal control design using the performance degradation 

r J I ratio which is defined as the supremum (over all possible initial conditions) of the ratio of the 

cost of the optimal controller with limited model information scaled by the cost of the optimal 
controller with full model information. Comparisons are made between designs based on limited, 

rl^ , statistical, and full model information. Throughout the paper, we use a power network example 

j^ ' to illustrate concepts and results. 
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1 Introduction 

en 

K>- ■ 1.1 Motivation 

t^^ I Large-scale systems such as automated highways |21I2] , aircraft and satellite formations [31[S] , supply 

Cn , chains [ElIT], power grids and other shared infrastructures [HUH] are typically composed of several 

locally controlled subsystems that are connected to each other either through the physical dynamics, 
m . the communication infrastructure, or the closed- loop performance criterion. The problem of designing 

^— ^ ' these local controllers, widely known as distributed or decentralized control design, is an old and 

^_j , well-studied problem in the literature [TUHT^ . Although the controller itself is highly structured for 

these large-scale systems, it is commonly assumed that the complete model of the system is available 
and the design is done in a centralized fashion using the global plant model information. However, 
this assumption is usually not easily satisfied in practice. For instance, this might be because the 
Vh ' design of each local controller is done by a separate designer with no access to the global plant 

model because the full plant model information is not available at the time of design or it might 
change later. Recently, this concern has become more important as engineers implement large-scale 
systems using off-the-shelf components which are designed in advance with limited prior knowledge 
of their future operating condition. Another reason to consider control design based on only local 
information is to simplify the tuning and the maintenance of the system. For instance, dependencies 
between cyber components in a large system can cause complex interactions influencing the physical 
plant, not present without the controller. Privacy concerns could also be a motivation for designing 
control actions using only local information. For further motivations behind optimal control design 
using local model information, see }17) . 

As an illustrative physical example, let us consider a power network control problem with power 
being generated in generators and distributed throughout the network via transmission lines (e.g., [181 
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[in]). It is fairly common to assume that the power consumption of the loads in such a network can 
be modeled stochastically with a priori known statistics, such as, mean and variance extracted from 
long term observations [20H22| . When the load variations are "small enough" , local generators meet 
these demand variations. These variations shift the generators operating points, and consequently, 
change their model parameters. If the loads are modeled as impedances, they change the system 
model by changing the transmission line impedances. As power networks arc typically implemented 
over a vast geographical area, it is inefficient or even impossible to gather all these model information 
variations or to identify all the parameters globally. Even if we could gather all the information and 
identify the whole system based on them, it might take very long and by then the information might 
be outdated (noting that the model parameters vary stochastically over time). This motivates the 
interest in designing local controllers for these systems based on only local model information and 
statistical model information of the rest of the system. We revisit this power network problem in 
detail for a small example in the paper. A recurring example is used to explain the underlying 
definitions as well as the mathematical results. It is not difficult to see that similar examples can 
also be derived for process control, intelligent transportation, irrigation systems, and other shared 
infrastructures. 

1.2 Related Studies 

Optimal control design under limited model information has recently attracted attention. The au- 
thors in [53] introduced control design strategies as mappings from the set of plants of interest to the 
set of eligible controllers. They studied the quality of these control design strategies using a perfor- 
mance metric called the competitive ratio; i.e., the worst case ratio of the closed- loop performance 
of a given control design strategy to the closed-loop performance of the optimal control design with 
full model information. Clearly, the smaller the competitive ratio is, the more desirable the control 
design strategy becomes since it can closely replicate the performance of the optimal control design 
strategy with full model information while only relying on local plant model information. They 
showed that for discrete-time systems composed of scalar subsystems, the deadbeat control design 
strategy is a minimizer of the competitive ratio. Additionally, the deadbeat control design strategy is 
undominated; i.e., there is no other control design strategy that performs always better while having 
the same competitive ratio. This work was later generalized to limited model information control 
design methods for inter-connected linear time-invariant systems of arbitrary order in [21] . In that 
study, the authors investigated the best closed-loop performance that is achievable by structured 
static state-feedback controllers based on limited model information. It was shown that the result 
depends on the subsystems interconnection pattern and availability of state measurements. When- 
ever there is no subsystem that cannot affect any other subsystem and each controller has access 
to at least the state measurements of its neighbors, the deadbeat strategy is the best limited model 
information control design method. However, the deadbeat control design strategy is dominated (i.e., 
there exists another control design strategy that outperforms it while having the same competitive 
ratio) when there is a subsystem that cannot affect any other subsystem. These results were gener- 
alized to structured dynamic controllers when the closed-loop performance criterion is set to be the 
7?2-norm of the closed- loop transfer function [53]. In this case, the optimal control design strategy 
with limited model information is static even though the optimal structured state-feedback controller 
with full model information is dynamic [3S1I17] . Later in [55] , the design of dynamic controllers for 
optimal disturbance accommodation was discussed. It was shown that in some cases an observer- 
based-controUcr is the optimal architecture also under limited model information. Finally, in |29| . 
it was shown that using an adaptive control design strategy, the designer can achieve a competitive 
ratio equal to one when the considered plant model belongs to a compact set of linear time-invariant 
systems and the closed-loop performance measure is the ergodic mean of a quadratic function of 
the state and control input (which is a natural extension of the _ff2-norm of the closed-loop system 
considering that the closed- loop system in this case is nonlinear due to the adaptive controller). 

In all these studies, the model information of other subsystems are assumed to be completely 
unknown which typically results in conservative controllers because it forces the designer to study the 
worst-case behavior of the control design methods. In this paper, we take a new approach by assuming 
that a statistical model is available for the parameters of the other subsystems. There have been 
many studies of optimal control design for linear discrete-time systems with stochastically-varying 
parameters [5im34j . In these papers, the optimal controller is typically calculated as a function of 



model parameter statistics. Contrary to those works, in this paper, we assume each controller design 
is done using the exact model information of its corresponding subsystem and the other subsystems' 
model statistics. 

Note that studying the worst-case behavior of the system using the competitive ratio is not the 
only approach for optimal control design under limited model information. For instance, the au- 
thors in [551457] developed methods for designing near-optimal controllers using only local model 
information whenever the coupling between the subsystems is negligible. However, not even the 
closed-loop stability can be guaranteed when the coupling grows. As a different approach, in a recent 
study [55], the authors used an iterative numerical optimization algorithm to solve a finite-horizon 
linear quadratic problem in a distributed way using only local model information and communication 
with neighbors. However, this approach (and similarly (391140) ) require many rounds of communi- 
cation between the subsystems to converge to a reasonable neighborhood of the optimal controller. 
To the best of our knowledge, there is also no stopping criteria (for terminating the numerical op- 
timization algorithm) that uses only local information. There have been some studies in developing 
stopping criteria but these studies require global knowledge of the system [JUJH] . Recently, there 
has been an attempt for designing optimal controllers using only local model information for linear 
systems with stochastically- varying parameters [43| . However, that setup is completely different 
from the problem that is considered in this paper. First, the authors of [43] considered the case 
where the B-matrix was parameterized with stochastic variables but in our setup the A-matrix is 
assumed to be stochastic. Additionally, in [35], the infinite- horizon problem was only considered for 
the case of two subsystems, while here we present all the results for arbitrary number of subsystems. 
In this paper, we introduce the concept of performance degradation ratio as a measure to study the 
value information in optimal control design. Furthermore, the proof techniques are different since 
the authors of [43] use a team-theoretic approach to solve the problem opposed to the approach 
presented in this paper. 

1.3 Main Contribution 

The main contribution of this paper is to study the value of plant model information available in the 
control design process. To do so, we consider limited model information control design for discrete- 
time linear systems with stochastically-varying parameters. First, in Theorem [TJ we design the 
optimal finite-horizon controller based on exact local model information and global model parameter 
statistics. We generalize these results to infinite- horizon cost functions in Theorem [2] assuming that 
the underlying system is mean square stabilizablc; i.e., there exists a constant matrix that can mean 
square stabilizes the system [30J. However, in Corollary [5] we partially relax the assumptions of 
Theorem [5] to calculate the infinite-horizon optimal controller whenever the underlying system is 
mean square stabilizablc under limited model information. This new concept is defined through 
borrowing the idea of control design strategies from [23l[24]. We define a special class of control 
design strategies to construct time-varying control gains for each subsystem. We say that a system 
is mean square stabilizablc under limited model information if the intersection of this special class 
of control design strategies (that use only local model information) and the set of mean square 
stabilizing control design strategies is nonempty; i.e., there exists a control design strategy that uses 
only local model information and it can mean square stabilizes the system (see Definition [3] for more 
details) . 

Using the closed-loop performance of the optimal controller with limited model information, we 
study the effect of lack of full model information on the closed-loop performance. Specifically, we 
study the ratio of the cost of the optimal control design strategy with limited model information scaled 
by the cost of the optimal control design strategy with full model information (which is introduced 
in Theorems [4] and [5] for finite- horizon and infinite-horizon cost functions, respectively). We call the 
supremum of this ratio over the set of all initial conditions, the performance degradation ratio. In 
Theorem [S] we find an upper bound for the performance degradation ratio assuming the underlying 
systems are fully-actuated (i.e., they have the same number of inputs as the state dimension). As 
a future direction for research, one might be able to generalize these results to designing structured 
state- feedback controllers following the same line of reasoning as in [44] . 



1.4 Paper Outline 

The rest of the paper is organized as follows. We start by introducing the system model in Section[2l 
In Section [31 we design optimal controller for each subsystem based on limited model information 
(i.e., using its own model information and the statistical belief about the other subsystems). We 
start by the finite-horizon optimal control problem and then generalize the results to infinite-horizon 
cost functions. In Sectional we introduce the optimal controller for both finite- horizon and infinite- 
horizon cost functions when using the full model information. In Section [5j we study the value of 
plant model information in optimal control design using the performance degradation ratio. Finally, 
the conclusions and directions for future research are presented in Section [51 

1.5 Notation 

The sets of integers and reals are denoted by Z and R, respectively. We denote all other sets with 
calligraphic letters such as A and X. Specifically, we define <S"+ (5") as the set of all symmetric 
matrices in R"^" that are positive definite (positive semidefinite). We denote the matrices by capital 
roman letters such as A. We use the notation Aij to denote a submatrix of matrix A (its dimension 
and position will be defined in the text). We use the notation Uij for the entry in the i*"^ row and the 
j*^ column of the matrix A. We define A > (>)0 as A £ 55+(5!f ) and A > {>)B a.s A-B> (>)0. 
Let A®B € K"PX9'" denote the Kronecker product between matrices A e R"""" and B £ Wt; i.e.. 



A®B = 



aiiB ■ ■ ■ aimB 



O-nlB ■ • ■ OnmB 



For any positive integers n and m, we define the mapping vec : K^^™ — > K"™ as vec{A) = 
[Aj Aj ■ ■ ■ A^j]^ where Ai, 1 < i < m, denotes the i^^ column of A. The mapping vec~^ : 
jjrHri _^ jjjixm jg ^j^^ invcrsc of vec(-), where the dimension of the matrix will be clear from the 
context. Finally, for any given positive integers n and m, we define the discrete Riccati operator 
R:R"><" X 5!f X R"^"^ X 5!p+ -^ 5!f as R(A,P,B,i?) = A'^ {P - PB{R + B^ PB^^B^^ P) A ioi any 
A G R"^", P eSl, B (^ R"><™, and R G Sl\. 

2 Control Systems with Stochastically- Varying Parameters 

Consider a discrete-time linear system with stochastically-varying parameters composed of N sub- 
systems with each subsystem represented in state-space form as 

N 

a;,;(fc + l) =^A,j{k)xj{k) + Bu{k)u,{k), (1) 

where Xi{k) G R"' and Ui{k) G R"'* denote subsystem i, I <i < N, state vector and control input, 
respectively. 

Remark 1 Linear systems with stochastically-varying parameters have been studied in many ap- 
plications including power networks \2(A\21^ . process control 1451 , finance JJS^, and networked con- 
trol I34\\471l - Various system theoretic properties and control design methods have been developed for 
these systems JM^ . 

We make the following two standing assumptions: 

Assumption 1 The submatrices Aij{k), I < i, j < N , are independently distributed random vari- 
ables in time; i.e., F{A,j{ki) G X\A,j{k2)} = P{Ay(fci) G X} for any X C M"»x"j when- 
ever ki ^ki. 

Assumption 2 The subsystems are statistically independent of each other; i.e., ¥{Aij{k) G X \ Ai>ji{k)} 
F{A,j{k) G X} for any X C ]R".x»j and 1 < j,j' < N whenever i ^ i' . 

We illustrate these properties on a small power network example. We will frequently revisit this 
example to demonstrate the developed results as well as their implications. 
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Figure 1 : Schematic diagram of the power network in Example [T] 



Example 1 Let us consider the power network composed of two generators shown in Figure [I] 
from l4-8[ pp. 64-65], see also U8^ . We can model this power network as 



5i{t)^uji{t), 
uJi{t) = ^[Pi{t) 



c^^ sin(Ji(t) - 62{t)) - c^i sin(5i(t)) - DiLo^{t)\ , 



and 



^2(t) = 



W2(i) 

1 
M2 



P2(t) - c-^2 sin(<52(t) - 6i{t)) ~ c^i sin(<52(i)) - ^2t^2(i)] , 



where Si{t), uJi{t), and Pi{t) are, respectively, the phase angel of the terminal voltage of generator i, 
its rotation frequency, and its input mechanical power. We assume that Pi(t) = 1.6 + Vi{t) and 
P2it) = 1.2 + V2{t), where Vi(t) and V2{t) are the continuous-time control inputs of this system. The 
power network parameters can be found in Table{^ (see flMT^ cmd references therein for a discussion 
on these parameters). Now, we can find the equilibrium point (iSJ'jfJJ) of this system and linearize 
it around this equilibrium. Let us discretize the linearized system by applying Euler's constant step 
scheme with sampling time AT = 300 ms, which results in 



'Mi{k + l) 
Awi(fc + 1) 
M2{k + 1) 
Aw2(fc + 1) 



1 
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ATcos((5*- 



■<5n 



C12M2 
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_ ATDi 

Ml 








ATcos(a^- 



■<5|) 



C12M1 

1 







AT 

ATD2 
A/2 



\A6i{k)] 







Awi(fc) 


+ 


ui{k) 


AS2{k) 





[Auj2ik) 




_U2{k)_ 



with 



a 



-AT{c^^ cos{Sl - S^) + c^^ cos{Sl)) 



6 



-ATjc^.,' cos(,5| - SI) + c,-^ cos{S*2)) 



where A5i{k), A52{k), Aa;i(fc), and ALU2{k) denote the deviation of 5i{t), S2{t), iOi{t), and L02(t) 
from their equilibrium points at time instances t ~ kAT. Additionally, let the actuators be equipped 
with a zero order hold unit which corresponds to Vi(t) = Ui{k) for all kAT < t < {k + 1)AT. Let us 
assume that we have connected impedance loads to each generator locally, such that the parameters 
ci and C2 vary stochastically over time according to the load profiles. Furthermore, assume that each 
generator changes its input mechanical power according to these local load variations (to meet their 
demand and avoid power shortage). Doing so, we would not change the equilibrium point ((5*, ^2)- 
For this setup, we can model the system as a discrete-time linear system with stochastically-varying 
parameters 

x{k + 1) = A{k)x{k) + Bu{k), 

where 



and 



A{k) 



(fc) 


= 


A5,{k) 

Auji{k) 

AS2{k) 

_ Auj2ik) _ 


; 


I 


c{k) = 


Ul(fc) 
_ U2{k) 


B = 




1 


_ 1 _ 


7 


- 


-45. 


1.0000 
6923-6.9^ 

23.5163 


!97a 


L(fc) 


0.300 
0.925 






3 
D 

-37.3 




29.3953 

1.0000 

757 -8.1485c 




Mk) 





.3000 
.9400 



Table 1: Nominal values of power system parameters in Example [T] 



Parameters 


Ml 


Ma 


C12 


Cl 


C2 


Di 


Da 


Nominal Value (p.u.) 


2.6 X 10-2 


3.2 X 10-2 


0.40 


0.50 


0.50 


6.4 X 10-3 


6.4 X 10-3 



where ai{k), i = 1,2, denotes the deviation of the admittance c^ from its nominal value in Table\^ 
Let us assume that ai{k) and a2{k) are independently and identically distributed random variables 
in time with ai{k) --A/'(0,0.1) and a2{k) -- A/'(0, 0.3). > 



We define the augmented system from ([T|) as 

x{k + 1) = A{k)x{k) + B{k)u{k), 
where 



(2) 



x{k) 



xi{k) 



XN{k) 



u{k) 



ui{k) 



UN{k) 



with n = X]i=i '"^i ^^d "^ — X]i=i ""^i- I^^t ^0 = a;(0). We also use the notations Aij{k) = E{Ay(fc)}, 
A,j{k) = Ay (fc)-A,j(fc), A(fc) = E{A(fc)}, and i(fc) == A(fc)-A(fc). Furthermore, for alll < i < iV, 
we introduce the notations 

0,^.-1 ^.™ 1 r 0,^.-1 ,^„ ■■■ 



B,{k) 



B^^{k) 

(Ef=, + i"j)xm» 



A(fc) = 






Am{k) 



(Ef=, + inj)X"i 







(IZiLi + injOxnjv 



Now, we are ready to calculate the optimal controller under model information constraints. 

3 Optimal Control Design with Limited Model Information 

In this section, we study the finite-horizon and infinite-horizon optimal control design using exact 
local model information and statistical beliefs about other subsystems. We consider state-feedback 
control laws Ui{k) = Fi{x{0)^ . . . ^x{k)) where in the design of Fi only limited model information 
is available about the overall system 1^. We formalize the notion of what model information is 
available in the design of controller i, 1 < i < -/V, through the following definition. 

Definition 1 The design of controller i, 1 < i < N , has limited model information if (i) the exact 
local realizations {Aij{k) | 1 < j < N} are available together with ('iij the first- and the second-order 
moments of the system parameters (i.e., ¥,{A{k)} and lL{A{k) (E) A{k)} ) . 



3.1 Finite-Horizon Cost Function 

In the finite-horizon optimal control design problem, for a fixed T > 0, we minimize the cost function 

JT{xo,Mk)}ll^)^EL{TyQ{T)x{T) + Y, (x{kfQ{k)x{k)+Y,uAkVRnik)uAk))], (3) 
'^ fc=0 ^ j=l ^ '' 

subject to the system dynamics in ^ and the model information constraints in Definition U) In (|3]), 
we assume that Q{k) e S^l for aU < fc < T and R{k) = diag(i?ii(fc), . . .,RNN{k)) G 5!f+ for all 
< k < T — 1. The following theorem presents the solution of the finite- horizon optimal control 
problem. 



Theorem 1 The solution of the finite-horizon optimal control design problem with limited model 
information is given by 



u{k) = - {R{k) + B{kyP{k + l)B{k))-^B{k)'^P{k + l)A{k)x{k) 

(i?ii(fc) + BiikyPik + l)Bi{k))-'Bi{kyP{k + l)ii(fc) 

{RNN{k) + BN{kyP{k + \)BN{k))-^BN{kyP{k + l)ijv(fc) 



=(fc), 



(4) 



where the sequence of matrices {P{ky\'k=o '^^"' ^^ calculated using the backward difference equation 

N 

P{k) = Q{k) + R(i(A:), P{k + 1), B(fc), i?) + ^ E {R(i,(fc), P(fc + 1), B.(fc), i?„;)} , (5) 

with the boundary condition P{T) = Q{T). Furthermore, inf r (.j,>it-i Jt{xo, {u(fc)}j.^o ) ^ Xq P{0)xo. 
Proof: We solve the finite-horizon optimal control problem using dynamic programming 

Vk{x{k)) = mm\x{kyQ{k)x{k)+u{kyR{k)u{k) + Vk+i{A{k)x{k)+B{k)u{k))\, (6) 

u{k) [ J 

where Vt{x{T)) = x{TyQ{T)x{T). Let us assume, for ah k, that 

Vkixik)) ^ x{kf P{k)xik) 

where P{k) G <S". This is without loss of generality since Vt{x{T)) = x{T)^Q{T)x{T) is a quadratic 
function of the state vector x{T) and using dynamic programming, Vk{x{k)) remains a quadratic 
function of x{k) if Vk+i{x{k + 1)) is a quadratic function of x{k + 1). To minimize the running 
cost dH]), in each time step 1<A:<T— 1, we solve 



d 



dui{k) 



N 



¥.i^x{ky Q{k)x{k) +^Uj{k)^ Rjj{k)uj{k) 

+ {A{k)x{k) + B{k)u{k)yP{k + l){A{k)x{k) + B{k)u(k)) \ = 0, 



(7) 



for all 1 < z < A^. We use the notations Ui{k) = E{iii(fc)} and Ui{k) — Ui{k) — Ui{k). Now, by 
taking expectation of the terms in ([7]) that subsystem i docs not know (i.e., model parameters of all 
subsystems j ^ i), we get 



N 



Ruik)u,ik) + B,{kyP{k + l){A{k) + Y, B,ik)ujik)) = 0, 



and 



Ru{k)u,{k) + B,{k)^P{k + l)(i,(fc) + B,{k)u,{k)) = 0. 
By stacking the equations in (|S]) for all 1 < z < A^, we get 

R{k)u{k) + B{kyP{k + l){A{k)x{k) + B{k)u{k)) = 0, 

where u{k) — [ui{k)^ . . . ■i2jv(fc)^]^. This results in the solution 

u{k) = K{k)x{k), 



(8) 
(9) 



(10) 



where K{k) = -{R{k) + B{ky P{k + l)B{k))-^B{ky P{k + l)^(fc). Furthermore, by solving ©, 
we get 



u,{k) ^ K,{k)x{k), 



(11) 



where Ki{k) = -{Ru{k) + B,{ky P{k + l)B^{k))-'^B,{ky P{k + l)Ai{k). By substituting the optimal 
controller from (fTO|) - ((TT|) inside the recm-sion (|6]), we get the cost function update equation 



x{k)^ P{k)x{k) = x{kyQ{k)x{k) 
+ x{ky {K{k)^R{k)K{k) + {A{k) + B{k)K{k))^P{k + l){A{k) + B{k)K{k))] x{k) 



(12) 



+ ^a;(fc)TE{i^,(fc)^i?,,(fc)i^,(fc)+(i,(fc)+B,(fc)i^,(fc))TP(fc+l)(i,(fc)+B,(fc)A',(fc))}x(fc), 
1=1 

By expanding and reordering the terms, we can simplify this equation as 

x{kyP{k)x{k) = x{kyQ{k)x{k) + x{k)'^ Ii{A{k) , P{k + 1), B{k), R)x{k) 

N 

+ Y, <ky^ {R(i,(fc), P(fc + 1), S,(fc), Ru)] x{k). 

4=1 



(13) 



Now, since the equality in (|13p is true irrespective of the value of the state vector x(fc), we get the 
recurrence relation in ^. This concludes the proof. D 

Remark 2 Theorem]^ shows that the optimal controller Ol) is a linear state-feedback controller and 
that it is composed of two parts. The first part is a function of only the parameter statistics (i.e., 
K{A{k)} and E,{A[k) ® A{k)}) while the second part is a function of exact local model parameters 
(i.e., {Aij{k) I 1 < j < N} for controller i). Note that the optimal controller does not assume any 
specific probability distribution for the model parameters. 

Remark 3 It might seem computationally difficult to calculate E{Ai(fc) ZAi(fc)} for each time-step 
k and any given matrix Z. However, as pointed out in fWJl, it suffices to calculate E{Ai(fc) ® Ai{k)} 
once, and then use the identity 

'£{Ai{ky Z{k)A,{k)] = vec-^ ( E | (A,{k) ® A,{k)\ ^ vec {Z{k)) 
= wec"ME|i,(fc)®i,(fc)| vec{Z{k)) 

3.2 Infinite-Horizon Cost Function 

In this subsection, we use Theorem [1] to minimize the infinite- horizon performance criterion 

Joo(2;o, {u(fc)}$?Lo) = 1™ Jt{xo, {w(fc)}^Jo ), 

1 — >oo 

where Q{k) = Q £ 5^+ and R{k) =Re Sl\ for all < fc < T - 1 and Q{T) = 0. For this case, we 
make the following standing assumption concerning the system parameters statistics: 

Assumption 3 For all time steps k, the stochastic processes generating the model parameters of the 
system in (0j satisfy 

• A{k) ^Ae R"^" and E{A{k) ® A{k)} = E G M"'^"'; 

• B{k) = B e 



p n X m 



These assumptions are in place to make sure that we are dealing with stationary parameter 
processes, as otherwise the infinite-horizon optimal control problem could lack physical meaning. 
We borrow the following technical definition and assumption from |30) . We refer interested readers 
to |30| for numerical methods for checking this condition. 

Definition 2 System (0) is called mean square stabilizahle if there exists a matrix L G R"'^" such 
that the closed-loop system with controller u{k) = Lx{k) is mean square stable; i.e., 
limfc^+ooE{a;(fc)Tx(fc)}=0. 

With this definition in hand, we are ready to present the solution of the infinite-horizon optimal 
control design problem with limited model information. 



Theorem 2 Suppose (0j satisfies Assumption\^and is mean square stahilizable. The solution of the 
infinite-horizon optimal control design problem, with limited model information is then given by 



u{k) = - (i? + B^PBy^B^PAx{k) 

{Rn+BjPBi)-^BjPAi{k) 



x{k), 



(14) 



{Rnn + BlPBN)-^Bj,PAN{k) 
where P is the unique positive-definite solution of the modified discrete algebraic Riccati equation 



N 

P^Q + R{A, P,B,R) + J2^ {R(i,;(fc), P, B,,Ru)] . 



(15) 



Furthermore, the closed-loop system (0j and |j^[) is mean square stable and 



r .iVL Joo{xo,{u{k)}T=o)^xJPxo. 

Proof: First, let us define the mapping / : S" — > 5" such that, for any X £ 5", 
f{X) = Q + A^ {X - XB{R + B^XB)-^B'^X) A 

N 

+ ^E {i7 {X - XB,{Ru + BjXB,)-^BjX) i,} . 



Using part 2 of Subsection 3.5.2 in |49] . we have the matrix inversion identity 

X - xw{z + w^xwy^w^x = {x-^ + wz-^w^y^, 

for any matrix W and positive-definite matrices X and Z. Tlierefore, for any X G '5"_|_, we have 

N 

f{X) = g + A'iX-^ + BR-^B'^y^A + ^E {i.7(X-i + B,R-^Bjy^A,^ . (16) 

Note that, if X > F > 0, then 

(x-i + wz-'^w^y^ > {Y-'^ + wz-'^w^y\ 

for any matrix W and positive-definite matrix Z. Therefore, if X > 1" > 0, we get 

fix) > f{Y) > 0. 

For any given T > 0, we define the sequence of matrices {Xi}f^f^ such that Xq — and X^+i = f{Xi). 
We have 

Xi = f{Xo) = /(o) = g > = Xo. 

Similarly, 

X2 = f{Xi) > f{Xo) = Xi>0. (17) 

The left-most inequity in ([T7)) is true because Xi > Xq- We can repeat the same argument, and 
show that for all 1 < i < T — 1, Xi+i > Xi > 0. Using Theorem [I] we know that 

xJXtXo = inf^_^ Jrixo, {w(fc)}^J(|). 

According to Theorem 5.1 in [3D| (using the assumption that the underlying system is mean square 
stabilizable), the sequence {Xi}°^Q is uniformly upper-bounded; i.e., there exists W G R"^" such 
that Xi <W for all i > 0. Therefore, we get 



lim Xt = X e 

T-»-|-oo 



(18) 



since {Xi}°^Q is an increasing and bounded sequence. In addition, we have X G iS"_|_ since Xi e S^_^_ 
for alH > 2 and {X^J^q is an increasing sequence. Now, we need to prove that the limit X in (fT8)) 
is the unique positive definite solution of the modified discrete algebraic Riccati equation (|T5|) . This 
is done by a contrapositive argument. Assume that there exists Z G 5" such that f{Z) = Z. For 
this matrix Z, we have 

z = f{Z) > /(O) - X, 

since Z > 0. Similarly, noting that Z > Xi, we get 

Z = f{Z) > f{Xi) = X2. 

Repeating the same argument, we get Z > Xi for all i > 0. Therefore, for each T > 0, we have the 
inequality 



inf^_i Jt{xo, {it(fc)}fc=o ) = -^0 XtXo 



< Xq Zxq 




(19) 

T-l ^ 

x{Ty Zx{T)+Y^ x{ky Qx{k)+u{ky Ru{k) I 

fc=0 J 

Note that the last equality in ([T^ is a direct consequence of Theorem [1] and the fact that Z = ^{Z) 
for any positive g G Z. Let us define {u*{k)}'^~^ = arginf r ,j,jit-i Jrixa, {uik)}'^!^), and x*{k) as 
the state of the system when the control sequence u*{k) is applied. Now, we get the inequality 

inf _ E i x{TYZx{T) + Y^ x{kYQx{k) + u{kY Ru{k) \ 

< E I x*{Ty Zx*{T) + ^ x*{kYQx*{k) + u{kyRu{k) \ , 

I A;=0 J 

since, by definition, {u*{k)^j.~^ is not the minimizer of this cost function. It is easy to see that 
the right-hand side of ^ is equal to JT{xo,{u*{k)}ll^) + E {a;*(T)^Z.T*(r)}. Thus, using ^ 
and dini), we get 

Xq XtXo < Xq Zxq 

< JT{xo,{u*ik)}llo')+^{^*(TyZx*{T)} (21) 

= x^XtXo + E {x*{TyZx*{T)} . 

Finally, thanks to the facts that Q > and 

lim E i V x*{kyQx*{k) + u*{kyRu*{k) \ = lim xj XtXq = xJXxq < oo, 
K fc=o ) 

we get that limr-^ooE {x*(r)^x*(r)} = 0. Therefore, we have limT^oo^ {x* {T)^ Zx*(T)} = 0. 
Letting T go to infinity in (|2T|) . results in xj Xxq = ^([Zxo for all xq G K". Thus, X = Z. This 
concludes the proof. D 

Remark 4 TVote that we can use the procedure introduced in the proof of Theorem [D to numeri- 
cally compute the unique positive-definite solution of the modified discrete algebraic Riccati equation 
in I115\) : i.e., we can construct a sequence of matrices {Xi}°^Q, such that Xi^i = f{Xi) with Xq = 
where /(•) is defined as in il6\) . Because of il8\) . it is evident that, for each 6 > 0, there exists a 
positive integer q{S) such that Xq(^s) ^s in the 6 -neighborhood of the unique positive-definite solution 
of the modified discrete algebraic Riccati equation U5\). Hence, the procedure generates a solution 
with any desired precision. 

Note that Definition [5] requires the existence of a fixed feedback gain L that ensures the closed- 
loop mean square stability. This might result in conservative results. In what follows, we relax this 
assumption to time- varying matrices. 
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Definition 3 System (0) is called mean square stabilizable under limited model information if there 
exist mappings Ti : R"»><"i x • • • x R"' 
with controller 



-^ 



t(fc) = 



^rriixni ^ 1 < z < N, suck that the closed-loop system 

ri(An(fc),...,Aiw(fc)) 



TN{ANi{k),'...,ANN{k)) 



<k), 



is mean square stable. 



Clearly, if a discrete-time linear system with stochastically-varying parameters is mean square 
stabilizable, it is also mean square stabilizable under limited model information. 

Remark 5 All fully- actuated systems (i.e., systems where mi = Ui for all 1 < i < N ) are mean 
square stabilizable under limited model information because, for each 1 < z < N , the deadbeat 
controller 



T,{A,i{k),...,A,N{k)) = Bl 



A,i{k) 



A,N{k) 



is based on limited model information and mean square stabilizes the system. 

As a price of relaxing this assumption to time- varying matrices, wc need to strengthen Assump- 
tion [31 

Assumption 4 The stochastic processes generating the model parameters of system |2|j satisfy that 

• The probability distribution of the matrices {A{k)}'^f^ is constant in time; 

• B{k) = B e M"^" for all fc > 0. 

Note that in Assumption [3] we only needed the first and the second moments of the system 
parameters to be constant. However, in Assumption |4] all the moments are constant. 

Corollary 3 Suppose (0j satisfies Assumption P] and is mean square stabilizable under limited 
model information. The solution of the infinite-horizon optimal control design problem with limited 
model information is then given by ^14\ l where P is the unique finite positive-definite solution of the 
modified discrete algebraic Riccati equation in 1115]) . Furthermore, the closed-loop system (0) and |i^[ ) 
is mean square stable and 

inf Joo(a;o, {it(fc)}fclo) = x^P^o- 

Proof: The only place in the proof of Theorem [2] where we used the assumption that the underlying 
system is mean square stabilizable, was to show that the sequence {Xi}^^ is upper bounded; i.e., 
there exists W G S" such that Xi <W for all i > 0. We just need to prove this fact considering the 
assumption that the system is mean square stabilizable under limited model information. To do so, 
note that for any T > 0, we have 

inf _ Jt{xo, {u{k)}ll^) ^ x^ XtXo < E < XI x{k)^ Qx{k) + u{kY Ru{k) \ , (22) 

where x{k) is the system state when it is initialized at x(0) — xq and the control law u{k) — T{k)x{k) 
is in effect with 

ri(An(fc),...,Aijv(fc)) 



r(fc) 



TN{ANiik),...,ANN{k)) 



Note that, at each time step k, r(fc) is independent of x{k) because of Assumption [T] Therefore, we 
have 



'T-l 



'T-1 



. fc=0 



E <j J2 x{kYQx{k) + u{k)'^Ru{k) \=^\Y^ x{k)^ {Q + T{k)'^ RT{k))x{k) \ 

CT-l 

= E i X x{ky{Q + E{r(fc)Ti?r(fc)})a;(fc) 



. fc=0 
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Furthermore, we can see that E{r(fc)^i?r(fc)} = R G 5" due to Assumption H] Now, let us define 
the sequence {VTj.^o such that Wq ^ Q + R and W,+i = E{(A(i) + BT{i))'^W,(A(i) + BT{i))}. 
Notice that 

A(W,+i) < E{{Aii) + BTii))'^ {A{i) + Br{z))}XiW,), 

where A(-) denotes the largest eigenvalue of a matrix. Again, considering Assumption 31 it is easy to 
see that E{(A(i) + BT{i)y{A{i) + BT{i))} = [/ for a fixed matrix U e E"''" and as a result, we get 

{T-l ^ /T-1 \ /T-1 

Y, x{kViQ + RMk) [ - 4 E ^''^ Po ^ HWo)x^ Y. ^ 
k=0 ) \k=0 I \fc=0 

Now, we just need to show that C/ is a Schur matrix; i.e., A(C/) < 1. We prove this part using a 
contrapositive argument. Let us assume that \J is not a Schur matrix; i.e., there exists a vector 
u G M" such that u^Uu = p > 1. Wc fix the initial condition xq = u. Now, note that 

E{x{k + lfx{k + 1)} = E{x{k)^{A{k) + BT{k))^{A{k) + BT{k))x{k)} 

= E{x{k)^E{{A{k) + BT{k))'^{A{k) + BT{k))}x{k)} (23) 

= E{x(fc)^t/x(fc)}, 

where the second equality is a direct consequence of the fact that matrices T{k) and A(k) are 
independent of x{k) due to Assumption [T] Following (P^. we get E{x{k)^ x{k)} = p^v7 u and as a 
result, limfc_!.oo E{a;(fc)^x(fc)} = oo. This is in contradiction with the fact that the underlying system 
is mean square stabilizable with the controller gain r(fc). Hence, \{U) < 1. Using (j22p . we get 

XoXtXo <^\Y1 ^ikVQ^ik) + u{kyRu{k) \ < A(Wo)X([ ( XI ^ po 

lfc=0 J \fc=0 / 

< A(Wo)x([ ( ^ f/M xo < x'^Wxo, 

\k=0 ) 

where W — X{Q + R){I — U)^^ G <S". This inequality is indeed true irrespective of the initial 
condition xq and the time horizon T. Therefore, Xi < W for all i > 0. The rest of the proof is 
similar to that of Theorem [H □ 

Example 1 (Cont'd) Let us introduce the quadratic cost function 

Joo{xo, {w(fc)}r=o) = E I ^ x{k)^x{k) + u{k)^u{k) \ . 

Following Theorem\^ we can easily calculate the optimal controller with limited model information 
as 



u'^^'ik) 



42.7701 + 8. 0694ai(A:) -1.6741 -29.1868 0.1041 
-23.2274 0.1757 34.4246 + 6.8698a2(/c) -1.7331 



x{k). 



Clearly, the control gain Li G M}'^'^ of controller Ui{k) = Li{k)x{k), i — 1,2, is a function of only its 
corresponding subsystem's model parameter ai{k). \> 

An interesting question is what is the value of model information when designing an optimal 
controller; i.e., having only access to local model information how much does the closed-loop perfor- 
mance degrade in comparison to having access to global model information. To answer this question 
for the setting considered in this paper, we need to introduce the optimal control design with full 
model information. 

4 Control Design with Full Model Information 

In this section, we consider the case where we have access to the full model information when 
designing each subcontroUer. Hence, we make the following definition: 
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Definition 4 The design of controller i, 1 < i < N , has full model information if (i) the entire 
model parameters {Aij[k) \ 1 < i, j < N} are available together with ('iij the first- and the second- 
order moments of the system parameters (i.e., E{A(A:)} and K{A{k) ® A{k)}). 

We have the following result for the finite-horizon case. 

Theorem 4 The solution of the finite-horizon optimal control design problem with full model infor- 
mation is given by 

u{k) = -{R + B{k)^P{k + l)B{k))-^B{k)^P{k + l)A{k)x(k), (24) 

where {^(fc)}fcLo '^'^'^ ^^ found using the backward difference equation 

N 

P{k) = Q{k) + R(i(fc), P(fc + l),B{k),R) + ^ E {R(i.(fc), P{k + l),B{k),R)^ , (25) 

4=1 

with the boundary condition P{T) = Q{T). Furthermore, inf r (.j,>it-i Jt{xo, {u{k)} i,~q ) = Xq P{0)xo. 

Proof: The proof is similar to the proof of Theorem [T] and therefore omitted. D 

This result can be extended to the infinite-horizon cost function. However, we first need to 
present the following definition. 

Definition 5 System (0j is called mean square stabilizable under full model information if there ex- 
ists a mapping T : M"^" — >■ R™^" such that the closed-loop system with controller u{k) = T{A{k))x{k) 
is mean square stable. 

Theorem 5 Suppose (0) satisfies Assumption and is mean square stabilizable under full model 
information. The solution of the infinite-horizon optimal control design problem with full model 
information is then given by 

u{k) = -{R + B^PB)-^B^PA{k)x{k), (26) 

where P is the unique finite positive- definite solution of the modified discrete algebraic Riccati equa- 
tion 

N 

P^Q + R(A, P, B, i?) + ^ E {R(i,(fc), P, B,R)Y (27) 

i=l 

Furthermore, this controller mean square stabilizes the system and infr^a-jioo ^00(2^0, {'"(fc)}fc°^o) ~ 
Xq Pxq. 

Proof: The proof is similar to the proofs of Theorem [5] and Corollary [31 D 

Example 1 (Cont'd) Following Theorem\^ the optimal control design with full model information 



IS 



42.7701 + 7.9708ai(fc) -1.6741 -29.1868 - 0.1035a2(fc) 0.1041 
-23.2274 -0.1215ai(fc) 0.1757 34.4246 + 6.7725a2(fc) -1.7330 



u™^(fc) = 
Note that the gain of controller i depends on the global model parameters. 



x{k). 



5 Performance Degradation under Model Information Limi- 
tation 

In this section, we study the value of the plant model information using the closed-loop performance 
degradation caused by lack of full model information in the control design procedure. The perfor- 
mance degradation is captured using the ratio of the closed-loop performance of the optimal con- 
troller with limited model information to the closed-loop performance of the optimal controller with 
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global plant model information. Let {u^^^{k)}'^Q and {u^^^{k)}'^Q denote the optimal controller 
with limited model information (Theorem [2]) and the optimal controller with full model information 
(Theorem [5]) , respectively. We define the performance degradation ratio as 



sup 



Joo(x-o,K^^(fc)}r=o) 



.oe£"^oo(xo,{«™Hfc)}r=o)' 

Note that r > 1 since the optimal controller with full model information always outperforms the 
optimal controller with limited model information. 

Example 1 (Cont'd) In this example, we compare the closed-loop performance of the optimal con- 
trollers under different information regimes. We have already calculated the optimal controller with 
limited model information as well as the optimal controller with full model information for this nu- 
merical example. Now, let us find the optimal controller using statistical model information based 
on \30^ . Using Theorem 5.2 from \30^ . we get 



u^"\k) 



-41.9043 -1.7873 -29.3969 -0.0121 
-23.3180 +0.0435 +32.7901 -1.8779 



x{k). 



Note how these three control laws depend on the plant model parameters. The control u [k) has 
a static gain depending on the statistical information of the A-matrix, while u^^^{k) and u^^^{k) 
depend on the actual realizations of the stochastic parameters. Now, we can explicitly compute the 
performance degradation ratio 

T pLMI 

r= sup °^». = 1 + 2.266 xlO-^ 
,„m^ xJP™'xo 

This shows that the performance of the optimal controller with limited model information is practically 
the same as the performance of the optimal controller with full model information. It is interesting 
to note that with access to (precise) local model information, one can expect a huge improvement 
in the closed-loop performance in comparison to the optimal controller with only statistical model 
information because 

sup ° ,„ " = 5.8790. 

> 

Next we derive an upper bound for the performance degradation ratio r. We do that for fully- 
actuated systems. 

Assumption 5 All subsystems ([ip are fully-actuated; i.e., B^ G M"'^"» and g_{Bu) > e > for all 
1 < i < N , where ct(-) denotes the smallest singular value of a matrix. 

To simplify the presentation, we also assume that Q = R = I . This is without loss of generality 
since the change of variables {x' ,u') = {Q^/^x,R^^^u) transforms the cost function and state space 
representation into 

^00(^0, {w'(fc)}£o) = lim E J y x'{k)'^x'{k) + u'{k)'^u'{k) \, 

U=o ) 

and 

x'{k + 1) = Q^/^A{k)Q~^/^x'{k) + Q^/^BR-^/^u'{k) = A'{k)x'{k) + B'u'{k). 

The next theorem presents an upper bound for the performance degradation. 

Theorem 6 Suppose (0) satisfies Assumptions\^and\^and is mean square stabilizable under limited 
model information. The performance degradation ratio is then upper hounded as r < 1 + 1/e^ where 
e > is defined in Assumption\^ 
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Proof: Using the modified discrete algebraic Riccati equation ^7} in Theorem \E\ the cost of the 
optimal control design with full model information Joo(a;o, {'u-^^^{k)}'kLo) = Xq P^^^xq is equal to 

N 

xJP™^xo = xjQxo + xjR{A, F™i^ g, I)xo + ^ x^E {R(i,;(fc), P™i, B, /)} xo- (28) 

In addition, we know that p^^^ > Q = I, which (using the proof of Theorem [2) results in 

R{A,P^^\B,I) >-R{A,I,B,I), (29) 

R(i,(fc), P™\ B, I) > R(i,(fc), /, B, I). (30) 

Substituting (ESll-dSni) inside ^ gives 

N 

4p™i.to > 4(/ + i^(/ + BB^)-^A)xo + Y, x^E {i,(fc)^(/ + B,Bf)-^A,{k)} xo- 

On the other hand, for a given xq £ M", the cost of the optimal control design with limited model 
information Joo(a;o, {"^^^(fc)}fcLo) ~ x^P^^^x^ is upper-bounded by 

( H-oo ^ 



tlP^^^XQ < E < 5Z xi^V^C^) + u{kyu{k) 



. fe=0 



where u{k) = —B^^A{k)x{k) and x{k) is the state vector of the system when this control sequence is 
applied to the system. This is true since the deadbeat control design strategy u{k) = —B^^A{k)x{k) 
uses only local model information for designing each controller [T7]. Therefore, we got 



^P^^^xo<E{x^{I + A{kyB-^B-^A{k))xo} 

= Xo{I + A'^B-^B~^A)xo + x^E |i(fc)^B"^S"^i(fc)| xo 

N 

= 4(/ + A'^B-^B-^A)xo + ^4e [Mk)^BT^^Br^^Mk)y. 



The second equality is a direct result of the assumption that the subsystems are stochastically 
independent of each other. Let us define the set Air = {/3 G M | r < /3} where r is the performance 
degradation ratio. If /? e R satisfy /^pF^i _ pLMi > q^ ^j^^^^ p ^ j^^ -y^^ ^^,^^^ 

ppFMi __ pLMi > (^ _ \)I+A^[p{I + BB^)-^ - B-^B~^]A 

N 



J2 E {MkV [I3{I + B,Bj)-' BTl^BT^] Mk)] 



i=l 
jFMI pLMI 



Therefore, a sufficient condition for /3P^^^^^ - P^^^^^ > to hold is that 
iP - 1)1 + A^ [p{I + BB^)-^ - B-^B-^] A 

N 

+ J2 E{A,ikf[PiI + B,Bj)-^ B-jBT^']Ukj^ > 0. 

Note that if /? > 1 + l/e^, we get 

p{I + B.,BJ)-^-B-,^B^^>Q. 
Therefore, we have 

/3(/ + BB^)-' - p-^p-i=diag(/3(/ + BiBj)-'-B^,^B^,\ ■■■,13(1 + BnB],)-'-B]^IB]^],)>0. 
As a result, we get [1 -I- 1/e^, +oo) C A^^. This shows that 

4PLMI:,„ 1 

D 
As the power network in Example [T] is not fully-actuated, we consider another power network 
example to the illustrate the previous result. 
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Example 2 Consider DC power generators, such as solar farms and batteries. Suppose these sources 
are connected to AC transmission lines through DC/ AC converters that are equipped with a droop- 
controller \5(M51}j . Let us assume that both power generators in Figure 1 are such DC power generators 
equipped with droop- controlled converters. We can then model this power network as 

Slit) - -i- [Pi{t) - c{l sin(,5i(t) - b2{t)) - c^^ sin((5i(t)) - i?ic^i(i)] , 

and 

'^2W ^ ^[P2{t) - c^^ sm{52{t) - 5i{t)) - c^^ sm{52{t)) - D2U2{t)\, 

i->2 

where 5i{t), 1/Di > 0, and Pi (t) are respectively the phase angel of the terminal voltage of converter i, 
its converter droop-slop, and its input power. The power network parameters in this example are the 
same as the ones in Example]^ except Di ~ D2 = 1.0. Now, similarly to Example\^ we find the 
equilibrium point of this nonlinear system, linearize it around this equilibrium, and then, discretize 
the system with sampling time AT = 300 ms to get 



A5i(fc + r 
A52(fc + i; 



AT cos{&l-Sl) 
C12D2 



C2 



ASi{k) 
AS2{k) 



+ 



ui{k) 

U2{k) 



wher 



Ci = i- 



AT{c^2 cos{Sl - bl) + q^ cos((5*)) 



C2 = l- 



AT{cl^ cos(5* + bX) - C2-1 cos(5*)) 



Di D2 

Consider the same variation of the local loads as in Example]^ We get the discrete-time linear with 
stochastically-varying parameters 



where 



and 



x{k) 



Abiik) 
Ab2{k) 



Aik) = 



x{k + l) ^ Ax{k) + Bu{k) 
u{k) 
-0.1635 -0.2075ai(fc) 



Ml(fc) 
U2{k) 



B = 



1 
1 



0.7486 
0.7486 -0.1897 - 0.0877a2(fc) 

where ai{k) ^ A/'(0, 0.1) and a2{k) ~ A/'(0, 0.3). The goal is to optimize the performance criterion 



J = eIJ2 x{k)^x{k) + u{kYu{k) \ . 



. fc=0 



Following Theorem [5l we can calculate the optimal controller with full model information as 



u^'^"{k) 



0.1166 + 0.1185ai(fc) -0.4334 - 0.0027a2(A:) 
-0.4334 - 0.0064ai(fc) 0.1317 + 0.0502a2(A:) 



x{k). 



Furthermore, using Theorem\^ we can calculate the optimal controller with limited model information 
as 



u'^^'ik) 
It is easy to see that 



0.1166 + 0.1190ai(A:) -0.4334 

-0.4334 0.1317 + 0.0504a2(fc) 



,{k). 



sup 



xlP'^^'xQ 



1 + 1.2660 X lO"'' < 1 + 1/e^ = 2, 



since e = 1 . In this example, the upper bound computed in Theorem is not tight. 
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Remark 6 Under Assumption\^ when the variances of the plant model parameters tend to infinity, 
the optimal controller with limited model information (introduced in Theorem 0) approaches the 
deadbeat control law. The intuition behind this result is that when the model information of the other 
subsystems is inaccurate, the deadbeat control law (which decouples our subsystem from the rest of 
the plant) is the best controller to use. The presented approach balances in a natural way the use of 
statistical information about the plant parameters with precise knowledge of their realizations. 

Example 2 (Cont'd) Let us consider the case where variances of the plant model parameters are 
very large. Hence, we assume ai{k) ^ 7V(0, 1000) and 02 (fc) ~ 7V(0, 3000). Now, the optimal 
controller with limited model information is given by 



0.1635 + 0.2075ai(fc) -0.7485 

-0.7485 0.1897 + 0.0877a2(fc) 



x{k), 



u^'^'ik) = 
which is practically equal to the deadbeat control law in Remark\^ > 

6 Conclusion 

We presented a statistical framework for the study of control design under limited model information. 
We found the best performance achievable by a limited model information control design method. 
We also studied the value of information in control design using the performance degradation ratio. 
Possible future work will focus on generalizing the results to discrete-time Markovian jump linear 
systems and to decentralized controllers. 
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